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[57] ABSTRACT 

A signal processor for use with an imaging sensor sys- 
tem that provides enhanced video imagery. The signal 
processor may be coupled to a FLIR system, for exam- 
ple, which comprises a plurality of detectors that are 
scanned across an image scene and reference tempera- 
ture source during separate portions of each scan cycle. 
The signal processor comprises an input processor cou- 
pled to the imaging sensor system which processes 
analog signals derived from each of the plurality of 
detectors. The input processor normalizes the analog 
signals relative to one another during the active portion 
of the scan cycle based upon stored data derived from a 
predetermined sensor responsivity calibration proce- 
dure. This normalization function equalizes the gains 
associated with all channels of the sensor system. The 
input processor also restores the DC levels of each of 
the sensor channels to respective DC values related to 
the reference temperature source during the inactive 
portion of the scan cycle. This function is performed 
during the calibration procedure and while the system is 
in operation. The input processor digitizes the signals 
which are applied to a scan converter. The scan con- 
verter stores the digitized signals and converts the 
stored signals into signals which are compatible with a 
video monitor employed to view the image. An output 
processor is coupled to the scan converter that is em- 
ployed to process signals in a manner which permits 
software-controlled digitized image enhancement 
thereof, and which converts the enhanced signals into 
analog video output signals compatible with the video 
monitor. 

11 Claims, 4 Drawing Sheets 
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the analog signals relative to one another during the 
SIGNAL PROCESSOR FOR AN IMAGING SENSOR active portion of the scan cycle based upon stored data 
SYSTEM derived from a predetermined sensor responsivity cali- 
_ _ oration procedure. This normalization function equal- 
BACKGROUND OF THE INVENTION 5 izes the gains associated with all the channels of the 
The present invention relates generally to signal pro- sensor system. The input processor also processes the 
cessors for use in processing video data, and the like, analog signals in order to restore the DC levels of each 
and more particularly to signal processors for use with of the sensor channels to respective DC values related 
multi-sensor imaging systems, such as forward looking to the reference temperature source during the inactive 
infrared imaging systems, and the like, which provide 10 portion of the scan cycle. This DC restoration function 
electronically enh a n ced video images displayed on a is performed during the calibration procedure and while 
video monitor. the system is in operation. The input processor pro- 
Conventional forward looking infrared (FUR) sen- cesses the normalized and DC restored signals to pro- 
sor systems, and the like, are employed as night vision vide digitized first output signals therefrom, 
systems on aircraft, tanks, ships and other military vehi- I 5 The signal processor also comprises a scan converter 
cles. The conventional FLIR system for example, com- coupled to the input processor which stores the digi- 
prises a sensor system, a signal processor and a video tized first output signals in memory and processes the 
display. The sensor comprises a large number of detec- stored digitized signals to provide second digitized out- 
tors whose signal outputs are multiplexed and applied to put signals which are compatible with the video moni- 
the signal processor. The signal processor electronically 20 tor. The scan converter ftmctions as a demultiplexer and 
demultiplexes, enhances and converts the sensor signals interpolator for the signal processor. An output proces- 
«h . , W 5?" k M "£ at ? e ™ th v ' dc ? d ?V l *y> sor is coupled to the scan converter which is employed 
£ ^^^JT^ t0 ^ f ° r to P roccss * e di^cd output signals in a rL- 
A^™ J^ii £ p , • , 5 < ncr which I*™* software<ontrolled digitized image 
ce£^ enhancememthereof, and which converts The enhanced 

SSes^^^ "22^ 

pie, prior art systems have typically incorporated re- S1 «^ s . ^P^We witf ^ the video monitor, 

sponsivity equalization circuitry, automatic gain control ^ E>Unng 1 °P cratl0n ' * e svstcm mcorporating 

circuitry and video compacting circuitry. However, 30 the s Ig nal 5?°^2?L of P rescnt mvcnt i 0 n is first 

these prior art systems have employed analog circuits to ^ aI ^ rat " 1 ' ^ f^ 1 * svstcm ^ comprise one hun- 

accomplish the gain control and video compacting drcd and sut y ( 160 > detcct <> r elements, for example, 

functions, and have incorporated manually operated whose out P uts «* multiplexed prior to their application 

potentiometers to implement the responsivity equaliza- to the signal processor. The detectors are typically 

tion function The use of manually-calibrated, analog 35 ? rie nted vertically and scanned horizontally across an 

systems in prior art FLIR signal processors, and the scene * Durin g the calibration procedure, the 

like, has resulted in less than optimum performance detectors are scanned across a uniform black body tem- 

from these systems. perature source. Each of the detector elements has a 

Although relating generally to staring focal plane different responsivity (gain) factor, and each has differ- 

detector arrays, a publication entitled "Reference-free 40 cnt W level errors during each scan cycle. The sensors 

nonuniformity compensation for IR imaging arrays," m scanned across the uniform temperature source 

SPIE, vol. 252, Smart Sensors II, 1980, pp, 10-17 dis- during the active portion of the scan cycle, and then 

cusses some conventional infrared signal processing during a retrace portion of the cycle, scanned across a 

problems and describes a reference-free compensation internal reference temperature source. The calibration 

scheme to accomplish automatic responsivity equaliza- 45 procedure is performed for approximately 30 to 40 scan 

tion. The compensation scheme described in this paper cycles. 

utilizes scene statistics to develop signals suitable for Gain correction constants for all detector channels 

implementing temperature compensation. are calculated automatically during the calibration pro- 

SUMMARY of thf twfwxiov CCdure ' ^ correction constants are fixed for each 
SUMMARY OF THE INVENTION ^ detcc to r and do not change during normal operation. 
In order to overcome the limitations of prior art sig- The gain correction constants are stored in a nonvola- 
nal processing systems, the present invention provides tile memory in the input processor and are recovered at 
for a signal processor which may be employed with an system power-up. The DC error correction factors are 
imaging sensor system, such as a forward looking infra- computed during each scan cycle and applied to the 
red (FLIR) system, or the like. The FLIR system, for 55 sensor signals currently being processed. A micro- 
example, comprises a plurality of sensors, or detectors, processor, or the like, is employed to compute and 
which are scanned across an image scene during a first control the signal processing in the input processor, 
portion of a scan cycle (the active portion), and scanned The gain and DC level-corrected signals are then 
across an internal reference temperature source during digitized and stored in scan converter memory. The 
a second portion of the scan cycle (the inactive or re- 60 scan converter includes an interpolation section which 
trace portion). The signal processor of the present in- converts the digital data associated with each scan cycle 
vention provides enhanced video output signals to a into a field of data compatible with the video monitor, 
video display or monitor which are representative of For example, the sensor system may have 160 lines of 
the image scene. video, due to the fact that it has 160 vertically-aligned 
The signal processor comprises an input processor 65 detectors, which must be converted into 480 line video 
coupled to the imaging sensor system which processes processed by the video monitor, 
analog signals derived from each of the plurality of The output processor includes a look-up table which 
detectors. The input processor is adapted to normalize is stored in nonvolatile memory. The look-up table 
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comprises a stored transfer curve which implements a video monitor. The signal processor 20 will be de- 
image enhancement functions. The look-up table is gen- scribed with reference to its use in conjunction with a 
crated utilizing statistics derived from a histogram and a forward looking infrared (FLIR) system. It is to be 
histogram equalization algorithm implemented in the understood, however, that other imaging sensors, such 
microprocessor. A software control program imple- 5 as synthetic aperture radar systems or standard video 
mented in the microprocessor performs image enhance- sensors may also utilize the signal processor 20, and that 
ment functions that improve the image on the video the scope of the present invention is not limited to FLIR 
monitor. Such functions as automatic level control, systems. 

automatic gain control, video compacting, image inver- The signal processor 20 comprises an input processor 
sion and gamma correction may be implemented. The 10 21 which has inputs that are adapted to receive analog 

output processor also includes aperture correction cir- input signals derived from the FLIR sensor. The input 

cuitry which is adapted to enhan ce the horizontal mod- processor 21 performs automatic responsivity equaliza- 

ulation transfer function (MTF) of the system in order tion and DC restoration functions and converts analog 

to improve the system frequency response. signals into digital signals compatible with a digital scan 

The software-controlled digital image enhancement 15 converter 22 coupled to its output, 

features of the present invention may be implemented The digital scan converter 22 is adapted to demulti- 

using a relatively small amount of standard integrated plex the applied signals and convert them into signals 

circuits. The system provides for adaptive calibration, compatible with the video monitor. The scan converter 

in that gains of all sensor channels are equalized during 22 converts image data derived from a vertical detector 

the calibration procedure and the calibration factors are 20 array which is scanned horizontally into data compati- 

stored indefinitely for use by the system. The tempera- ble with standard TV format, which is a horizontal 

ture of the reference temperature source need not be array scanned vertically. The scan converter 22 thus 

known for the system to operate properly. The DC performs an orthogonal rotation of the image data tim- 

levels of all detectors in the system are restored auto- ing and hence operates to reformat the image scene 

matically to the DC reference temperature defined by 25 data. 

the reference temperature source. There are no manual The scan converter 22 has an output which is coupled 

adjustments to be made during calibration or operation. to an output processor 23. The output processor 23 is 

Image enhancement functions are provided in a look- employed to process the reformated data in a manner 
up table instead of being calculated by means of analog which permits software-controlled digitized image en- 
circuits as in conventional signal processors. A wide 30 hancement thereof. In addition, the output processor 23 
dynamic range is achieved using digital image-process- converts these enhanced reformatted signals into analog 
ing circuitry and techniques. Increased system fre- video output signals compatible with the video monitor, 
quency response is achieved by means of the aperture Timing circuitry 24 is employed to control the clock- 
correction circuitry. Flexibility and growth of the sys- ing. of signals through the signal processor 20 and to 
tem is possible and may be implemented by means of 35 synchronize the throughput of data from the FLIR 
changes to software programs. signal source to the video monitor. A computer proces- 

BRIEF DESCRIPTION OF THE DRAWINGS ^ such as a microprocesor 25, or the like, is coupled 

. to the components of the signal processor 20 in order 

The various features and advantages of the present control the data processing functions thereof. The mi- 
invention may be more readily understood with refer- 40 croprocessor 25 controls processing of the analog input 
ence to the following detailed description taken in con- data to implement the gain equalization function in the 
junction with the accompanying drawings, wherein like input processor 21, and controls the computation of 
reference numerals designate like structural elements, algorithms which generate the histogram and look-up 
^jL" 1 wnich: toble transfer function in the output processor 23. A 

FIG. 1 shows a block diagram of a signal processor in 45 more detailed understanding of the function of the mi- 
accordance with the principles of the present invention; croprocessor 25 will be obtained with reference to the 

FIG. 2 shows a block diagram of an embodiment of detailed figures discussed hereinbelow. 

an input processor for use with the signal processor of Referring to FIG. 2, a detailed block diagram of one 

■ embodiment of the input processor 21 is shown. This 

FIG. 3 shows a block diagram of an embodiment of 50 portion of the signal processor 20 comprises a summing 

an output processor for use with the signal processor of circuit 31 which receives as inputs, the analog input 

a signals from the FLIR signal source, and analog signals 

FIG. 4 shows a block diagram of an embodiment of a representative of the automatic responsivity equaliza- 

aperture correction circuit for use with the output pro- tion (ARE) correction constants and DC restoration 

CC ^°I I ? G ' 3; * 55 G* 0 ** corr^on factors. The signal output of the 

FIG. 5 shows a functional block diagram of the signal summing circuit 31 is processed by a first A to D con- 
processor of FIG. 1; and verter 32 and then applied to the scan converter 22. 

FIG. 6 shows a graph of a typical histogram over- Automatic responsivity equalization and DC restora- 
layed with a representative transfer curve implemented tion concepts are generally well known in the signal 
by the output processor of the present invention. 60 processing art Exemplary of automatic responsivity 
DESCRIPTION OF THE PREFERRED f^ ntro1 circuitrv *? U.S. Pat. No. 4,345,148 entitled 

EMBODIMENT Automatic resonsivity control for a CCD imager," 

assigned to the assignee of the present invention. Ac- 
Referring to FIG. 1, a block diagram of a signal pro- cordingly, a detailed discussion of these concepts will 
cesser 20 in accordance with the principles of the pres- 65 be dispensed with. 

ent invention is shown. The signal processor 20 is The automatic responsivity equalization (ARE) and 
adapted to receive analog input signals derived from a DC restoration (DCR) factors are generated by the 
video signal source, and apply the processed signals to following circuitry. A clamping voltage reference is 
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generated by a DCR clamp reference circuit 33 which prises video signals which are compatible with the in- 

is coupled to the output of the D to A converter 32. The tensity levels of the monitor. The output of the D to A 

DCR clamp reference circuit is coupled to an up/down converter is coupled through aperture correction cir- 
counter 34, whose output is adapted to increment or cuitry 49 to an output amplifier 50 whose output is 

decrement DC restoration factors. The microprocessor 5 coupled to the video monitor. 

25 is coupled to a RAM memory 35, a non-volatile FIG. 4 shows an embodiment of the aperture correc- 

memory 39, and automatic responsivity equalization tion circuitry 49 for use in the output processor 23 The 

and DC restoration register circuits 36, 37, respectively. aperture correction circuitry 49 is adapted to boost the 

The DC restoration circuit 37 is coupled through a first frequency response of the system and hence improve 

D to A converter 38 to the summing circuit 31 while the 10 the modulation transfer function (MTF) of the system, 

automatic responsivity equalization circuit 36 is coupled The circuitry 49 utilizes a time delay circuit 52 and a 

through a multiplying D to A converter 39 to the sum- variable resistor network 53 which feeds signals to a 

ming circuit 31. summing circuit 54. This circuit operates as a cosine 

The scan converter 22 of FIG. 1 is not shown in detail filter. The operation of combining time-delayed signals 

m any figure. Digital scan converters are well known in 15 with currently processed signals boosts the gain above 

the art, and the construction of this component of the certain frequencies and improves the system frequency 

signal prcessor 20 will not be discussed in detail herein. response. 

However, a representative sample of a scan converter The operation of the signal processor 20 of the pres- 

which could be adapted for use with the present inveri- ent invention will be explained with reference to FIG. 

tion is described in U.S. Pat. No. 3,947,826, entitled 20 5, which shows a functional block diagram of the signal 

"Scan Converter," and issued to the assignee of the processor 20. The system will be described with refer- 

present invention, ence to its use with the FLIR sensor system. The FLIR 

The interpolation section of the scan converter 22 sensor comprises a plurality of detectors, 160 for the 

comprises an algorithm implemented in hardware purpose of this discussion. The outputs of the 160 chan- 

which converts, for example, FLIR scan line format 25 nels are multiplexed in the FLIR sensor prior to their 

(160 lines per field) to TV video scan line format (240 application to the signal processor 20. 

lines per field). The particular implementation practiced The multiplexed FLIR input signals are applied to 
in the present invention involves mapping of four sue- the summing circuit 31. The output of the summing 

cessive IR scan lines into six TV scan lines in a predeter- circuit 31 is processed by the automatic responsivity 

mined combinational manner. The particular algorithm 30 equalization circuitry 36. Gain factors are read from the 

maps four IR scan lines (A, B, C and D) into six TV non-volatile memory 39 into the RAM memory 35. The 

scan lines (A, i A+ }B, B, C, iC+ JD, D). stored values are then multiplied by the gain factors and 

Referring to FIG. 3, a block diagram of an embodi- added to the FLIR analog signals in the summing cir- 

ment of an output processor 23 for use in the signal cuit 31. In addition, DC restoration factors are deter- 

processor 20 of FIG. 1 is shown. The output processor 35 mined and added to the FLIR signals in the slimming 

23 comprises histogram generation circuitry 41 which circuit 31. 

includes window circuitry 45, a gate circuit 42, a histo- The output of the summing circuit 31 comprises sig- 

gram circuit 43 and in incremental counter 44. The nals which are DC restored and normalized relative to 

histogram generation circuitry 41 is adapted to process each other. These signals are then converted to digital 

digitized output signals received from the scan con- 40 data in the A to D converter 32 and stored in the scan 
verter 22 and generate a histogram of the number of converter 23. The scan converter operates in a manner 

occurences of signals at each infrared detector intensity which reformats and interpolates the digital data to 

level during each field time. The microprocessor 25 is adjust the number of scan lines to a number which is 

coupled to the histogram generation circuitry 41 for compatible with the video monitor. The output of the 

accessing the histogram data. 45 scan converter 22 is then applied to the output proces- 

Histogram equalization is generally well known in sor 23. 

the signal processing art and hence will not be discussed The output processor 23 utilizes the histogram gener-. 

in detail herein. Representative of histogram equaliza- ation circuitry 43 and the microprocessor 25 to generate 

tion techniques known in the art are described in U.S. a look-up table 46 in RAM memory which comprises a 

Pat. No. 3,979,555 entitled "Histogram equalization 50 transfer function that enhances the digital video image 

system for display improvement," and U.S. Pat. No. being processed. The look-up table contains multiplica- 

3,983,320 entitled "Raster display histogram equaliza- tive factors which are applied to the digital video data 

tion," both of which are assigned to the assignee of the in order to implement automatic gain control, automatic 

present invention. level correction, polarity reversal and gamma correc- 

The microprocessor 25 utilizes the histogram data to 55 tion. The signals emerging from the look-up table 46 
generate a look-up table 46 that is physically stored in comprises enhanced digital video signals that are con- 
RAM memory. The histogram data is employed to verted to analog video signals in the D to A converter 
convert the digitized reformatted unenhanced signals 47 and applied to the aperture correction circuitry 49. 
received from the scan converter 22 into enhanced The aperture correction circuitry 49 boosts the signal 
image data under control of the microprocessor 25. The 60 gain at predetermined frequencies. The aperture correc- 
look-up table 46 comprises data which allows the mi- tion compensates for modulation transfer function roll- 
CTOprocessor 25 to perform several image enhancement off caused by less than perfect optics, degraded video 
functions including automatic level correction, auto- monitor resolution and detector sampling in the FLIR 
matic gain control, polarity reversal and gamma correc- sensor. 

tl0n * 65 Presented hereinvelow is a general description of a 

The output processor 23 also comprises a D to A signal processor constructed in accordance with the 

converter. 47 which accepts inputs from the look-up principles of the present invention and employed as part 

table 46. The output of the D to A converter 47 com- of a forward looking infrared (FLIR) system. The sig- 
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nal processor will not be described with reference to *t~GK t+l. 
any specific figure. The signal processor processes eight 

parallel channels comprising 20 multiplexed signals to where G is the channel gain, K is the responsivity fac- 

implement image reformatting and video processing to tor, 

convert 160 parallel infrared detector outputs into stan- 5 T is the temperature difference seen by a detector and 
dard 525 line TV video output (480 lines of which are L is a level offset introduced by the electronics 
displayed). implies that, if ARE is set equal to K - 1, then each 
The eight parallel multiplexed infrared video channel detector output is normalized. These ARE values 
inputs comprise 20 detectors per channel. The input are computed in the initial calibration procedure 
signals from each of the 20 channels are DC restored, 10 and stored in non-volatile memory. Other relevant 
responsivity corrected and digitized to a 9 bit intensity equations include: 
level in eight input processor circuits. The digital infra- 
red video is reformatted by means of an orthogonal ARE=Kj-\, 
translation and stored in the memory of the scan con- 
verter. The image is stored in TV coordinates compris- 15 dcr=v 0 gk Ti+Lt-Voa&i+ARE). «nd 
ing 320 lines by 752 samples per line. The scan con- _ Vnr , ™ r ~ 
verter memory uses 64K RAM ICs and stores each 'i* 

fiC ^fc^ agC . in - 36 ^ t f tp r „ , Thc OCR values are updated each scan field. When 

Jfc^JX r! ° Ut CS ^ Pan ? Cl 20 detector * scanned over the thermal reference 

and interpolated to provide six TV lnes on the video 20 Mnw%M .u a „c+u~ a ♦ ^ 

?ru- A i , source, the output of the A to D converter is compared 

monitor. The interpolated video is sampled in the histo- i c xtnUc , . . . - y 

„, Q ~, r*,-^^, »L n | r f o r ~ e with 1.5 volts that corresponds to an expected reference 

gram memory that stores the frequency of occurrence «cw ^ u L- * j 

of each of the 512 (9 bit) intensity levels The histogram "™ *2££ ™ of 20 C above ambient and a 0.075 
is processed to provide automatic level and gain tnSd* X£5 ^ * " 

tion for the display video. The level and |ain control 25 processor, the corresponding DCR correction 

functions are implemented in the RAM lokup table 'S ^ "V ?* added t0 ***** 
that translates each IR intensity level to a video monitor T^J* ™£ ? *° 10 ? Up /" 
intensity level. Display gamma and image inversion fZL^"' ' 7 ^ «»P™« *«f « the 
correction factors are also stored in the look-up table, ^ C f C ^ A " p Sf down ******* u P° n the input 
The output of the look-up table is converted to an ana- 30 ^^l^^^Tl « ™> 
log signal, aperture corrected by means of the cosine * *"* ' m ? ni old ? CR corrcc - 

filtering technique, and then applied to the video moni- *> n 15 low > then theoomter is strobed to count up 
tor for viewing ^ the m P ut P lus Ae DCR correction is equal (nor- 

The major functions that affect the video output are ^ aU ^ 3) to !*t v ° lts ' If ^ FLIR detector m P ut plus 
automatic responsivity equalization (ARE), DC resto- 35 * e old te ™ » ^gh, then the counter is strobed to count 
ration (DCR), interpolation, automatic level correction down mt * th % ,S n0rm f ,ized * By P rovidin 8 sev ' 
(ALC), automatic gain correction (AGC), gamma cor- "" samples of the input to the counter, noise is aver- 
rection and aperture boost. The automatic responsivity aged °5 *° * 1 least bit (LSB) of the DCR 

equalization and DC restoration functions are accom- tenn * DCR correctIon » ±2 volte with 8 bit quan- 
plished in parallel on each of the eight multiplexed 40 ^tion thus providing DCR correction to ±16 milli- 
infrared video channels. ARE values are loaded into volts or ±0 ' 3 P^cenl of Ae A to D converter input 
RAM memory from non-volatile memory at system dynamic range. The new DCR correction is stored in 
turn-on. DC restoration is performed continuously to memorv 311(1 used to correct the* next active field scan of 
provide automatic compensation for the thermal envi- H 1 *:' . 

ronment of each detector in the infrared sensor. 45 Tne "^tial calibration of the ARE values is per- 

Automatic responsivity equalization values are gen- formed during the calibration mode. In this mode, the 
erated and updated by means of the calibration proce- scanning FLIR array looks at a uniform temperature 
dure. Both the DC restoration and responsivity equal- target. The FLIR thus scans a uniform source tempera- 
ization calibration are based on the detector array scan- ture durin 8 Ae active field scan time and scans the 
ning a uniform thermal reference source during the 50 thermal reference source during the inactive (retrace) 
inactive scan time (retrace). The dwell time on this portion of the field scan. With all the detectors looking 
source is relatively short (aproximately 300 microsec- at Ac same temperature difference between the active 
onds) but provides enough samples (32) to correct for . ficld-of-view and the thermal reference, the only differ- 
any DC droop and thermal change in the scene each enccs m output signal are caused by responsivity differ- 
scan field time. 55 ences between detectors. 

In the normal operating mode, each analog infrared Initially the ARE values are set to zero, and the DCR 
detector input signal to the signal processor is compen- offsets required for a uniform output are generated. The 
sated by adding a DC restoration term and multiplying average calibration scene temperature is then computed 
by a responsivity correction term to provide a voltage from successive histograms. This average scene 
to the A to D converter. The equation defining this 60 temperature is used as the comparator reference voltage 
relationship is to determine ARE values. This self adaptive compara- 

tor reference allows calibration of the detector array 
*o*={2J+ei-DCR)/o+ARE). with different calibration scene input, such as sky, 

ground or test target, and the like. The ARE values are 
The 2.5 volt constant centers the output applied to the 65 generated in a manner similar to the DCR terms by 
A to D converter. using the comparator to strobe the up/down counter to 

The equation correct the ARE value. The generation of ARE and 

DCR values is an iterative process. The new ARE 
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values shift the DCR values, which in turn adjusts the intensity level increases the count stored in memory for 

ARE values. This process in convergent, and after sev- the particular intensity. At the end of one IR field time, 

eral fields, the ARE and DCR terms are stable. the histogram is read out of the microprocessor to en- 

To further reduce the noise sensitivity of the ARE able computation of the gain and level adjustments. The 

terms, the actual stored ARE values represent the aver- 5 microprocessor also performs a low pass filter operation 

age of 32 consecutive ARE corrections. Since the DCR to mtcgratc frames of data< ^ ^ ^ md 

and ARE calibration is a closed loop system around the leve , settings are calculated from the filtered data. 
A to D converter, any channel-tc-channel processing ^ ^ and levd ^ ti ^ fa ^ 

differences are also compensated for automatically by * tMm ^ w ^ h lc , mH *h p au kv^T^ 

providing the same digital output for every detector for l0 P £ , u °f? m ^ by ^l 0 ' 

Se same delu tmperTture $ . 10 K'X^t? "tt*?™? ^ 9 

tion provides a range of a 1±0.5 multiplication foctor b ? dl *f FLIR ^ tens,ty to M 8 lt d ^ ^ 
with 8 bit quantization for an accuracy of ±0.21 per- ™ e 1"*™°* gamma correction factors for the 

cent at the A to D converter input display and image polarity factors are also stored in the 

Interpolation of the IR scan lines to TV lines is re- 1* 1^-up table Aperture boost is provided after D to A 

quired to map 320 IR lines to a 525 line TV display, 480 conversion of the video signals to compensate for MTF 

of which are used. The interpolation algorithm maps roUofT caused by optics, display resolution and detector 

four successive IR scan lines onto six TV lines. The sampling. The aperture correction provides a boost of 6 

interpolation is performed on an IR/TV field basis to dB at * B Nyquist sampling frequency (0.54 cycle/m- 
eliminate image break-up that would result if the entire 20 T=0.66 microseconds). 

IR/TV frame (two fields) were interpolated. This single Thus, there has been described a new and useful sig- 
field interpolation, while eliminating image break-up nal processor which may be employed to provide elecr 
caused by image or sensor motion, does introduce some tronically-enhanced video imagery. Software-con- 
resolution degradation in the vertical dimension. How- trolled digital image enhancement features of the pres- 
ever, in the dynamic scene environment of low-altitude ent invention may be implemented using a relatively 
flight, for example, the resultant image quality is better small amount of standard integrated circuits. The sys- 
with this form of field interpolation. tem provides for adaptive calibration and the calibra- 
Automatic gain and level adjustment is provided by tion factors are stored indefinitely for use by the system, 
collecting a histogram of the scene intensities, determin- The temperature of the reference temperature source 
S?^?* mmimU ? * nd maximum ^tensities from a used to calibrate the system need not be known for the 
7 5 by 10 degree window m the lower center of the field * syst em to operate properly. The DC levels of all detec- 
of view, or from the total scene. The field of view is tors m ^ systcm m rcstored automatically t0 the DC 

^tf 1 ^^!^ °h f™™ V' P* ^ refcrcncc temperature defined by the reference temper- 

ed level are then adjusted to display only the video ature m nQ adjustments ^ 

^ZZ^V^i™™ tT* • 35 ^de during calibration or operation. J 

ii^SLS^^ Image enhancement functions are provided in a look- 

W^r^f^f • P fi i tCr ^ reSpect t0 * e up table instead of being calculated by means of analog 
frame-to-frame maximums and minimums using the * •* ^ 1 • , ' . » 

following relationship: ™ cm * 35 m c ? nvc ^onal signal processors. A wide 

r dynamic range is achieved using digital image-process- 

Af/«jt(/-JVi-j)+JV|_i 40 m £ circuitry and techniques. Increased system fre- 

quency response is achieved by means of the aperture 
where I is the detected maximum or minimum, M is the correction circuitry. Flexibility and growth of the sys- 
maTiipimi or minimum used for subsequent compute- tcm possible and may be implemented by means of 
tion, M is the maximum or minimum from the previous changes to software programs, 
frame and K is a weighting factor. 45 II is to be understood that the above-described em- 

Using the maximum and minimum values, after filter- bodiment is merely illustrative of one of the many spe- 
ing, the gain and level values may be computed from CU 7 C embodiments which represent applications of the 
the following equations: principles of the present invention. Clearly, numerous 

and varied other arrangements may be devised by those 
G«2*/(M«-Min) 50 skilled in the art without departing from the spirit and 

scope of the invention. 
Z,-<M«+Min)/2 What is claimed is: 

v ■ * _ . « , ' , . , , 1. A signal processor for use with an imagine sensor 

L "fiflT?. L h ,eVeI m B T tlSt comprises.plurality of dctectoif which arc 

■£ outSS fiK^&l^ ^ f 55 "> image scene during a first portion of 

the^oloSeS™ " P fr ° m » «n cycle and scanned across a refine* temperature 

* ^ source during a second portion of said scan cycle, said 

KJ)=G(/-i,)+(2"/2-i) signal processor providing video output signals to a 

video monitor which are representative of said image 
J(J)<o. *(/)«o 60 scene, said signal processor comprising: 

input processor means coupled to said imaging sensor 
X(y»2 A "-i. X(i)=2 s -\ system for processing analog signals derived from 

each of said plurality of detectors in order to equal- 
where X(I) is the output value for input I, I is the input ize the gains of said analog signals relative to one 
for^O to 2 M - 1, and M is the number of input bits. 65 another another during said first portion of said 
The digital video from the interpolator is gated to the scan cycle based upon stored gain correction sig- 
histogram memory. Either the total field of view or the nals derived from a predeterrnined sensor respon- 
small window is sampled on alternate TV fields. Each srfvity calibration procedure, for processing arid 
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analog signals in order to restore the DC levels of 
signals derived from each of said detectors to DC 
values related to said reference temperature source 
during said second portion of said scan cycle, and 
for processing the equalized and DC restored sig- 
nals to provide digitized first output signals from 
said input processor means, said input processor 
means including means for generating automatic 
responsivity equalization factors and DC restora- 



12 



voltage reference signals for the computation of 
said DC restoration signals; and 
a counter circuit for processing to said voltage refer- 
ence signals in order to provide incrementing and 
decrementing signals to said first memory means 
which adjust and normalize said DC restoration 
signals relative to said fixed voltage reference dur- 
ing each scan cycle. 
5. The signal processor of claim 4 wherein said first 



tion values including circuit means for correcting 10 and second memory means further comprise: 



errors in said equalization factors resulting from 
adjustment of said restoration values and for cor- 
recting errors in said restoration values resulting 
from adjustment of said equalization factors; 

scan converter means coupled to said input processor IS 
means for storing digitized first output signals and 
processing the stored digitized signals to provide 
digitized second output signals which are compati- 
ble with said video monitor; and 

output processor means coupled to said scan con- 20 
verter means for processing said second digitized 
output signals in a manner which permits software- 
controlled digitized image enhancement thereof/ 
and for converting the enhanced second digitized 
output signals into analog video signals compatible 25 
with said video monitor. 

X The signal processor of claim 1 wherein said input 
processor means comprises: 

analog to digital conversion means for converting 
applied analog signals into said digitized first out- 
put signals; 

summing means for combining said analog signals, 
said DC restoration signals and said gain correction 
signals and applying the combined signals to said 
analog to digital converter; and 

computer processor means coupled to said analog to 
digital conversion means and said summing means 
for computing said DC level correction signals and 
for controlling combining of the analog signals, 
gain correction signals and DC level correction 40 
signals in a predetermined manner to provide sig- 
nals which are digitized by said analog to digital 
conversion means. 

3. The signal processor of claim 2 wherein said com- 
puter processor means comprises: 

a non-volatile memory for storing gain correction 
constants derived from said calibration procedure; 

first memory means coupled to said summing means 
for storing said DC restoration signals prior to their 
application to said summing means; 

second memory means coupled to said summing 
means for storing said gain correction signals prior 
to their application to said summing means; 

a computer processor coupled to said non-volative 
memory, said first and second memory means and 
said analog to digital converter for computing said 
DC restoration signals and storing them in said first 
memory means, for loading said gain correction 
signals from said non-volative memory into said 
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first and second random access memories; 
first and second digital to analog converters coupled 
between said first and second random access mem- 
ories, respectively, for converting digital signals 
stored in said memories into analog signals compat- 
ible with said analog to digital converter. 

6. The signal processor of claims 1, 2, 3, 4, or 5 
wherein said scan conversion means comprises: 

a scan converter for storing said digitized first output 
signals; and 

interpolation means coupled to said scan converter 
for converting the digitized first output signals into 
said digitized second output signals which are com- 
patible with said video monitor. 

7. The signal processor of claim 6 wherein said output 
processor means comprises: 

look-up table generation means for computing and 
storing a look-up table comprising image enhance- 
ment correction signals; 

digital to analog conversion means coupled to said 
look-up table generation means for converting 
signals received from said scan converter means 
into analog video output signals compatible with 
• said video monitor; 

aperture correction means coupled to said digital to 
analog converter for processing the enhanced sig- 
nals derived from said look-up table generation 
means in order to enhance the modulation transfer 
function of said system; and 

computer processor means coupled to said look-up 
table generation means for computing the signals 
comprising said look-up table. 

8. The signal processor of claim 7 wherein said look- 
up table generation means comprises: 

histogram generation means for generating a histo- 
gram of the number of occurrences of said first 
output signals at each intensity level associated 
with said sensor; 

a look-up table memory for storing said image en- 
hancement signals; 

said computer processor means computing said image 
enhancement correction signals utilizing said histo- 
gram and storing said computed signals in said 
look-up table memory. 

9. A signal processor for use with an imaging sensor 
system that comprises a plurality of detectors which are 
scanned across an image scene during a first portion of 
a scan cycle and scanned across a reference temperature 
source during a second portion of said scan cycle, said 



second memory means, and for controlling the 60 signal processor providing video output signals to a 
: * * video monitor which are representative of said image 

scene, said signal processor comprising: 
input processor means coupled to said imaging sensor 
system for processing analog signals derived from 
65 each of said plurality of detectors in order to equal- 
ize the gains of said analog signals relative to one 
another during said first portion of said scan cycle 
based upon stored gain correction signals derived 



processing of said analog signals, and said gain 
correction signals in order to combine said signals 
in said analog to digital converter. 
4. The signal processor of claim 3 wherein said first 
memory means comprises: 
a clamping voltage reference circuit coupled to said 
. analog to digital converter for processing output 
signals derived therefrom in order to provide fixed 
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from a predetermined sensor responsivity calibra- 
tion procedure, for processing said analog signals 
in order to restore the DC levels of signals derived 
from each.of said detectors to DC values related to 
said reference temperature source during said sec- 5 
ond portion of said scan cycle, and for processing 
the equalized and DC restored signals to provide 
digitized first output signals from said input proces- 
sor means, said input processor means including 
means for generating automatic responsivity equal- 10 
ization factors and DC restoration values including 
circuit means for correcting errors in said equaliza- 
tion factors resulting from adjustment of said resto- 
ration values, and for correcting errors in said res- 
toration values resulting from adjustment of said 15 
equalization factors. 
10. A signal processor for use with an imaging sensor 
system that comprises a plurality of detectors which are 
scanned across an image scene during a first portion of 
a scan cycle and scanned across a reference temperature 20 
source during a second portion of said scan cycle, said 
signal processor providing video output signals to a 
video monitor which are representative of said image 
scene, said signal processor comprising: 
input processor means coupled to said imaging sensor 22 
system for processing analog signals derived from 
each of said plurality of detectors in order to equal- 
ize the gains of said analog signals relative to one 
another during said first portion of said scan cycle 
based upon stored gain correction signals derived 30 
from a predetermined, sensor responsivity calibra- 
tion procedure, for processing said analog signals 
in order to restore the DC levels of signals derived 
from each of said detectors to DC values related to 
said reference temperature source during said sec- 35 
ond portion of said scan cycle, and for processing 
the equalized and DC restored signals to provide 
digitized first output signals from said input proces- 
sor means, said input processor means including 
means for generating automatic responsivity equal- 40 
ization factors and DC restoration values including 
circuit means for correcting errors in said equal iza- 
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tion factors resulting from adjustment of said resto- 
ration values, and for correcting errors in said res- 
toration values resulting from adjustment of said 
equalization factors; and 
means for converting and processing said digitized 
first output signals from input processor means into 
analog video output signals compatible with said 
video monitor. 
11. A signal processor for use with an imaging sensor 
system that comprises a plurality of detectors which are 
scanned across an image scene during a first portion of 
a scan cycle and scanned across a reference temperature 
source during a second portion of said scan cycle, said 
signal processor providing video output signals to a 
video monitor which are representative of said image 
scene, said signal processor comprising: 
input processor means coupled to said imaging sensor 
system for processing analog signals derived from 
each of said plurality of detectors in order to equal- 
ize gains of said analog signals relative to one an- 
other during said first portion of said scan cycle 
based upon stored gain correction signals derived 
from a predetermined sensor responsivity calibra- 
tion procedure, for processing said analog signals 
in order to restore the DC levels of signals derived 
from each of said detectors to DC values related to 
said reference temperature source during said sec- 
ond portion of said scan cycle, and for processing 
the equalized and DC restored signals to provide 
digitized first output signals from said input proces- 
sor means, said input processor means including 
means for generating accurate automatic respon- 
sivity equalization factors and accurate DC resto- 
ration values including means for substantially 
eliminating offsets in restoration values resulting 
from adjustment of equalization factors, and vice- 
versa; and 

means for converting and processing said digitized 
first output signals from said input processor means 
into analog video output signals compatible with 
said video monitor. 
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